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Abstract. It has long been known that antibiotic treatment wih not completely kill off a bacteria 
population. For many species a small fraction of bacteria is not sensitive to antibiotics. These bacteria 
are said to persist. Recently it has been shown that persistence is not a permanent state and that in fact 
a bacterium can switch back and forth between persistent and non persistent states. We introduce two 
stochastic models for bacteria persistence. In both models there are mass killings of non persistent bacteria 
at certain times. The first model has deterministic killing times and the second one has random killing times. 
Both models suggest that persistence may be a successful strategy for a wide range of parameter values. 

Key words: bacteria persistence, stochastic model, branching process, random environment 

AMS Classification: 60K35 

1. Introduction 

Since at least Bigger (1944) it is known that antibiotic treatment will not completely kill off a bacteria 
population. For many species a small fraction of bacteria is not sensitive to antibiotics. These bacteria are 
said to be 'persistent'. It turns out that persistence is not a permanent state. In fact a bacterium can switch 
back and forth between a 'normal' (i.e. non persistent) state and a 'persistent' state. In a normal state a 
bacterium can reproduce but is killed by an antibiotic attack. In the persistent state a bacterium does not 
reproduce (or very seldom) but is resistant to antibiotics, see Balaban et al. (2004), Kussell et al. (2005) 
and Lewis (2007). Persistent bacteria may play an important role in treatment failure and in the appearance 
of bacteria with inherited resistance to antibiotics (a major health concern), see Levin (2004), Wiuff et al. 
(2005) and Levin and Rozen (2006). 

In this paper we consider two models for this phenomenon. In both models there are mass killings of non 
persistent bacteria at certain times. The first model has deterministic killing times and the second one has 
random killing times. Both models are random in that giving birth to a new bacterium and switching back 
and forth between persistent and non persistent states all happen randomly. It is believed that switching 
is random for several species of bacteria, for the biology of persistence see Dubnau and Losick (2006) and 
Graumann (2006). 

For the deterministic killing time model we assume that at certain fixed times all the normal bacteria 
are killed off and only the persistent ones survive. We will show that for all parameter values the bacteria 
population has a positive probability of surviving provided the time interval between two successive killings 
is larger than a certain critical value. We will also show that this critical value is not very sensitive to even 
large variations in parameter values. This seems to suggest that persistence is a successful strategy for a 
wide range of parameter values. We also show a similar behavior for the model where the killing occurs at 
random times. For this second model we concentrate on the particular case for which time intervals between 
two killings is an i.i.d. sequence of exponentially distributed random variables. 
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2. Deterministic killing times 

Consider the following continuous time model. Baeteria can be in one of two states. We think of state 1 
as being the normal (i.e. non persistent) state and state 2 as being the persistent state. Note that the normal 
state is vastly predominant in the population. A bacterium in state 1 is subject to two possible transitions. 
It can give birth at rate A to another state 1 individual or it can switch to state 2 at rate a. A bacterium in 
state 2 has only one possible transition. It can switch to state 1 at rate h. Moreover, the bacteria in state 1 
can be killed in the following way. Let Ti = iT for i > 1 where T is a fixed positive constant. This defines 
a sequence of killing times Ti , T2 , . . . . At each killing time Ti all the bacteria in state 1 are killed but the 
bacteria in state 2 are unaffected. 

The model mimics the observed behavior. State 1 bacteria multiply until disaster strikes and then they 
all die. State 2 bacteria cannot give birth but persist under disasters. Hence, state 2 bacteria ensure survival 
through disasters but cannot give birth. Our hypothesis that bacteria in state 2 cannot give birth or die is 
not unrealistic. See Table 1 in Kussel et al. (2005). 

The main question we are concerned with in this paper is for which parameter values do the bacteria 
survive? The following result answers this question. 

Theorem 1. For any a > 0, 5 > and A > there is a critical value Tc such that the bacteria survive 
forever with positive probability if and only ifT > Tc- 

The exact value of Tc depends on the parameters a, b and A. However, Tc varies very little with a and 
b, see Figure 1. The value of Tc is more sensitive to variations of A. See Figure 2. 



Figure 1. This is the critical value Tc as a function of a and b. The parameters a and b vary from 10 
to 10^'^ and A is fixed at 2. 
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Figure 2. This is the critical value Tc as a function of A. We set a = 10~^ and b — 10^^. 
2. Random killing times 

We now turn to random killing times. The growth and switching back and forth rates A, a and b are the 
same as before. The only difference with the model above is that the killings now occur at random times. 
We consider a sequence {Tk)k>i of i.i.d. random times which is also independent of everything else in the 
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model. At each Tk we kill all the bacteria in state 1 and the state 2 bacteria arc unaffected. Many choices are 
possible for the distribution of the random times. We choose to concentrate on the exponential distribution. 
That is, we assume that {Tk)k>i is an i.i.d. sequence with probability density 5exp{—6t) where 6 > 0. 

Theorem 2. Let a > 0, 6 > and A > 0. There exists 6c > such that: 

• if d < 5c, then the model with random kiUing times has a positive probabiUty of surviving, 

• if 6 > 5c, then the model with random killing times always dies out. 

Note that the expected killing time is 1/5. It plays the role of T in the previous model. 

Balaban et al. (2004) and Kussell et al. (2005) have used differential equations to model persistence. In 
their model they use a certain set of parameter values when the environment is a 'growth' environment and 
a different set of values when the environment is a 'stress' environment. They use the model to compute 
long term fitnesses for persistent and normal states. Our Theorem 1 shows that even for very small values 
of a, b and A the bacteria may survive provided the interval between two killing times is long enough is 
consistent with their findings. However, their model unlike ours is very sensitive to parameter variations, 
see their Discussion. 

Garner et al. (2007) also use differential equations to model persistence but they are closer to our 
approach in that they kill all the normal bacteria at certain fixed times. They use their model to compute 
the ideal fraction of persistent bacteria in a population. Note that Gardner et al. (2007) also consider 
deterministic and random (exponentially distributed) killing times. 

3. Proof of Theorem 1 

We start our process with finitely many bacteria. Wc now define an auxiliary discrete time stochastic 
process n > 0. We wait until the first killing time T and we let Zq be the number of bacteria in state 2 
at time T. If = we set Zj = for i > 1. If Zq > 1 then we wait until the second killing time 2T and 
let Zi be the number of state 2 bacteria at time Zi . More generally, for any > 1 let Z^ be the number of 
state 2 individuals at the {k + l)-th killing time (fc + 1)T. 

We claim that the process (Zfe)fc>o is a Galton- Watson process. This can be seen using the following 
argument. Each state 2 bacterium present at time Ti = T starts a patch of bacteria. Note that in order for 
the patch to get started we first need the initial state 2 bacterium to switch to state 1. At the second killing 
time T2 all the individuals in state 1 are killed and we are left with Zi individuals in state 2. If Zi = 
the bacteria have died out. If Zi > 1 then each 2 present at time Ti starts its own patch. Each patch will 
live between times T2 and T3. These patches are independent and identically distributed. At time T3 each 
2 (if any) starts a new patch and so on. This construction shows that {Zk)k>o is a Galton- Watson process. 
Moreover, the bacteria population survives forever if and only ii Zk > 1 for all k > 0. For ii Zk = for 
some k > 1 this means at the corresponding killing time T^+i there are no type 2 individuals and no type 

1 individuals either. That is, the bacteria have died out. If on the other hand Zk > 1 for all fc > the 
bacteria will survive forever. Now, it is well known that a Galton- Watson process survives if and only if 
E{Zi\Zq = 1) > 1, see for instance Schinazi (1999). That is, the analysis can be done starting with a single 
state 2 bacterium. Hence, the problem of survival for the bacteria population is reduced to computing the 
expected value E{Zi\Zq = 1). Wc do this computation next. 

For t < Ti let x{t) be the expected number of type 1 bacteria and y{t) be the expected number of type 

2 bacteria at time t, starting at time with a single type 2 and no type 1. We have for /i > 

x{t + h)-x{t) = Xhx{t)-ahx{t)+bhy{t) + o{h), 
y{t + h)-y{t) = ahx{t)-hhy{t) + o{h). 

This yields the following system of differential equations 

j^x{t) = {\-a)x{t) + by{t), 
^v{t) = ax{t)-by{t). 
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This is a linear system with constant coefficients. The corresponding matrix 



1^1 



A — a b 
a —b 

has two real distinct eigenvalues vi and U2 

-a-b + X + y/A 
2 

-a-b + X- a/A 
-2 = ^ , 

where 

A = {a + b- Xf + 4bX> {a + b- Xf. 

Note that the determinant of A is —Xb < 0. Hence, fi > and 1^2 < 0- A standard computation yields the 
solution of the system of differential equations, see for instance Hirsch and Smale (1974). We get 

b-a + X + y/A a-b-X + VA . . 
x{t) = C2 — exp(z^it) - ci — exp(i/2f) 

y{t) = ci exp(!/2t) + C2 exp(!/ii). 
We now find the the constants ci and C2 by using the initial conditions a;(0) = and y(0) = 1. We have 

b-a + X + y/A , 

ci = y= and C2 = 1 — ci. 

2VA 

Since \/A > |a + 6 — A| we have ci > 0. It is also easy to check that ci < 1. Hence, C2 > 0. 

It is not difficult to sec that the function y drops from y{0) = 1 to some minimum and then increases 
to infinity as t goes to infinity. Hence, there is a unique > such that y{Tc) = 1. The critical value Tc 
is computed numerically by solving the equation y{t) = 1. For any T > Tc the Galton- Watson process Z). 
is super-critical and survives forever with a positive probability. For T < Tc the process dies out. This 
completes the proof of Theorem 1. 



4. Proof of Theorem 2. 

This proof is similar to the proof of Theorem 1. We now define a process Z'/. that will play a role analogous 
to the one played by Z).. 

We wait until the first killing time Ti and we let Zq be the number of bacteria in state 2. If = we 
set = for i > 1. li Zq > 1 then we wait until the second killing time T2 and let Z[ be the number of 
state 2 bacteria. More generally, for any fc > 1 let Z'f. be the number of state 2 individuals at the {k + l)-th 
killing time Tk+i. 

The process (Z^)fe>i is a branching process in an i.i.d. environment. To see this consider the 2's present 
at time Ti + ■ ■■ + Tk+\ for a fixed A; > 0. Each one of these 2's is starting a patch that will last for the 
random time It is this random time that determines the random environment for each patch. Given 

Tfc_|_2 all patches are independent and identically distributed. Moreover, the patch distribution does not 
depend on k. This fits the definition of a branching process in an i.i.d. environment. Smith and Wilkinson 
(1969) introduced branching processes in i.i.d. environments, see also Athreya and Karlin (1971). We will 
thus use the known criteria for survival and extinction for a branching process in an i.i.d. environment to 
prove Theorem 2. Note that so far everything we wrote is true for any distribution for the killing times. We 
start now concentrating on exponential killing times. 

Let Y{Ti) be the number of 2's present at the first killing time Ti starting the model with a single 2 at 
time 0. Note that given Ti = t the mean value of Y{Ti) is y{t) where y{t) is the expected number of 2's 
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given that the kihing time Ti > t. The type of killing time (deterministic or random) does not affect the 
function y and we have already shown that 

y{t) = ci exp(!/2t) + C2 exp(!/ii). 

Let us recall the criteria for the survival of the branching process in a random environment, in our context: 

Theorem (Smith and Wilkinson, 1969). Assume that ^|ln(y(ri))| < oo. 

a) If E{\n{y{Ti))) < 0, then extinction occurs with probability 1. 

b) If -E(ln(y(Ti))) > and E\ lnP(F(Ti) > 1)| < oo, then the process survives with positive probability. 
• We first check the integrability condition E\ ln(?/(Ti))| < oo. In our setting, 

E\ln{y{T,))\ = / | lny(t)|,5exp(-(5f)dt. 
Jo 

Recall that there is a positive real Tc such that y{t) <1 fov t <Tc and y{t) > 1 for t > Tc. We have 

/ \\ny{t)\5 exTp{-5t)dt = / lny(t)(5exp(-(5t)dt. 
Note that for t > 0, y{t) < (ci + C2) exp(z^it) = exp(z/it). Hence, 

/ \\ny{t)\5exg{-5t)dt< ^. 

Hence, E\ \n{y{Ti))\ < 00 for 5 > 0. 

The next task is to study the sign of m', where 

m' = E{hi{y{Ti))) = / ln{y{t))6 exp{-6t)dt. 



• We first show that m' is positive for S near 0. Observe that y{t) > C2 exp(i^it) and therefore 

roo 

/ Iny{t)dexp{-St)dt>lnc2 + ^. 
Jo " 

Hence, for 6 < — i^i/lnc2 we have m' > 0. This ensures survival provided the integrability condition 
E\ ln(P(F(Ti) > 1)1 < 00 holds. We now check this. Recall that we start the process with a 2. If by time 
Ti the 2 has not flipped to state 1 we have Y{Ti) = 1. Hence, 

P{Y{t) > 1) > e-*"* and | In P(y(i) > 1)| < bt. 

Therefore, 

b 



^ < 00. 




E\ ln(P(y(Ti) > 1)1 = / I \nP{Y{t) > 1)\6 exp{-6t)dt < / btSexp{-St)dt ■ 
Jo Jo 

This proves the process survives with positive probability for 5 small enough. 

• We now turn to the proof that m' is negative for 5 large enough. By a change of variable we get 

m' = lnyC^)exp{—u)du. 
Jo t> 
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The function y is infinitely differentiable everywhere and a Taylor expansion gives 

2/(|)=2/(0) + ^y'(0) + (|)V(c(«,^)) 
where < c{u, 6) < j. Recall that y(0) = 1 and that ln(l + x) < a; for a; > —1. Hence, 

_ U ,U 2 III 



lnt/(^)<^2/'(0) + (^)V(cK<5)), 



and 

m' 



' < y'(0) ^e-"dn + {\fy"{c{u, 5))du = ^ + - y^ «'/(c(u, <5))dn. 



Since y'(0) < to show that m' < for large S it is enough to show that /q°° u'^y"{c{u, S))du is bounded for 
6 larger than some 62- We do so now. Note that since vi > vi 

y"{t) = C1V2 ex.p[i'2t) + 02^1 exp(z/if) < Kexp{i'it), 

where K = 2max(cif2, C2Z^i). Since vi > 0, 

u 

y"{c{u,5)) < K exp{uic{u, S)) < K exp{iyi-). 



Hence, for S > ui 



Therefore, 



f f u 

0< / u'^y"(c(u,5))du< K exp(ui-)du = 

Jo Jo 



2K 



< limsup / u^y"{c{u, 6))du < 2K. 
6^00 Jo 

This proves extinction for S large enough. 

• We now prove that the probability of surviving is a non-increasing function of the intensity 6 of killing 
times. 

In the specific case of exponential killing times, there exists a natural coupling of the processes for distinct 
values of the killing parameter S that we now explain. Assume that the delays {Tk)k>i between two killing 
times are independent exponential random variables with parameter 6, then the sequence of killing times 
{Sk = Ti)k>i is a Poisson point process with intensity S. The classical decimation procedure allows to 

make a coupling between two Poisson point processes {Si~)k>i and (<S'^)fe>i with respective intensities S' > S 
such that (Sfe)fc>i is a subsequence of (<S'^)fe>i. 

Let us explain briefly this procedure. Let (T'^)a;>i be an i.i.d sequence of exponential random variables 
with parameter 5': the killing times {S'f. = Yli=i 1'i)k>i are a Poisson point process with parameter 5' . 
Consider next a sequence {ek)k>i of i.i.d. Bernoulli random variables with parameter 5/5' . Then in the 
sequence {S'^)k>i; wo keep the fc-th point S'^. if gfc = 1 and erase it otherwise. Doing so, we obtain a new 
sequence {Sk)k>i that is a Poisson point process with intensity 5. 

Let us now explain a graphical construction for our bacteria growth process. 

• Let T be the following binary tree. The set V of vertices is the set of finite words on the alphabet 
{0, 1}, the root is the empty word 0, and a non-empty word V1V2 ■ ■ .Vn-iVn is linked to his parent 
V1V2 ■ ■ ■ Vn-i and to his two children V1V2 ■ ■ ■ v„_iw„0 and V1V2 ■ ■ ■ u„-iw„l. 

• We now add a time coordinate. Consider a family {Sv)v£V of iid random variables following the 
exponential law with parameter A: Sy represents the time between the birth of the particle at v and 
its splitting time (i.e. when the particle gives birth). Set 

T0 = and € V\{%} =Y^ S^, 
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where the sum is taken on all the ancestors w of v {9 included, v excluded). 
We build a new tree T in T x [0, +00): the set V contains the points 

{v, Ty) and {v, Ty + Sy) for v€V. 

For each t; e F we do the following. We draw a vertical edge between {v,Ty) and {v,Ty + Sy): this edge 
corresponds to the time between the birth at v and its splitting time. We also draw an horizontal edge 
between {v, Ty + Sy) and each of its two children {ve, Ty + Sy), e G {0, 1}: this edge corresponds to the 
splitting of the particle v in two. Let rjt be the number of living particles at time t, or, equivalently in the 
graphical setting, the number of vertical edges intersecting the horizontal plane with time coordinate 
t. Then (rit)t>o is a continuous time branching process with rate A. 

• Now we add the switches between the two states 1 and 2. Consider, independently of everything built 
before, two families of independent Poisson point processes {uDy^v and (w^)^gy such that and 
ujy are independent Poisson point processes on the half-line {v} x [0, +00) with respective intensity a 
and b. Now we color the tree in white and red as follows. We start from (0, 0) in white, we color each 
branch of the tree following the time direction, changing the color to red every time we meet a point 
in one on the Poisson point processes changing the color to white every time we meet a point 
in one on the Poisson point processes {uiDy^y White segments correspond with bacteria in normal 
state, while red segments correspond to persistent bacteria. 

• As persistent bacteria cannot split, at each red splitting point, we cut the horizontal red edge that goes 
to the son whose name ends with a 1 and erase the corresponding subtree. 

Then the number r]} of white vertical edges - resp. rj^ of red vertical edges - intersecting the horizontal 
plane with time coordinate t correponds to the number of normal - resp. persistent - bacteria living at time 
t in our model when no killing occurs. 

Independently, we consider the previous coupling of the two Poisson point processes (5fe)fe>i and (5^)fe>i 
of killing times. To recover the bacteria process with killing rate S - resp. 5' --, we just have to cut, at every 
time Sk - resp S'^ - all the white edges, and to erase the corresponding subtrees. As {Sk)k>i is a subsequence 
of (<S'j.)/s>i, it is clear that the bacteria process with killing intensity 6' is a subtree of the bacteria process 
with killing intensity d. In particular, the probability of surviving is a non-increasing function of 6. 

• We finally remark that 5 n- m'{5) = \n{y{t))S cxp{—St)dt is a continuous function of 6, which 
ensures that in'{dc) < 0, and thus that the process almost surely dies out when 6 = 5c- 
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